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Abstract — This paper investigates the problem of sparse sup- 
port detection (SSD) via a detection-oriented algorithm named 
Bayesian hypothesis test via belief propagation (BHT-BP) | 7 |,| 8 ]. 
Our main focus is to compare BHT-BP to an estimation-based 
algorithm, called CS-BP |3], and show its superiority in the SSD 
problem. For this investigation, we perform a phase transition 
(PT) analysis over the plain of the noise level and signal mag- 
nitude on the signal support. This PT analysis sharply specifies 
the required signal magnitude for the detection under a certain 
noise level. In addition, we provide an experimental validation to 
assure the PT analysis. Our analytical and experimental results 
show the fact that BHT-BP detects the signal support against 
additive noise more robustly than CS-BP does. 

Index Terms — Noisy sparse recovery, sparse support detection, 
phase transition, belief propagation. 



I. Introduction 

Noisy sparse recovery is referred to the problem of recov- 
ering a sparse signal x G ^ N from noisy linear projection 
y G M M generated by an underdetermined system (M < N). 
In such a problem, sparse support detection (SSD) is important 
because once the support is known, the uncertainty to the 
recovery is confined to the additive noise, which can be 
optimally solved in terms of mean squared errors using the 
simple least square approach [ 1 ]. Nevertheless, most recovery 
algorithms to date for the problem have been developed under 
the auspices of signal estimation rather than support detection. 
They include algorithms developed under the criteria of the 
/i-norm minimization and the MAP-estimation such as least 
absolute shrinkage and selection operator (LASSO) and 
Baysian compressive sensing via belief propagation (CS-BP) 
1 3], respectively. 

Thus, we make note of the fact that these estimation-based 
algorithms may not be good choices when it comes to the SSD 
problem under noisy setup. Indeed, recently several studies 
have indicated that the existing estimation-based algorithms 
lead to a potentially large gap with respect to the theoretical 
limit for the noisy support recovery |4]-(6]. Wainwright and 
Akcakaya et al have shown that LASSO, a sparse signal 
estimator, has a significant performance gap from the Fano's 
detector which is information-theoretically optimal, in the 
linear sparsity regime |4|,[5|. Furthermore, Fletcher et al 
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noted the suboptimality of LASSO and OMP compared to 
the maximum likelihood detector and they remarked that the 
gap grows as SNR increases 0. 

In this paper, we consider a recently proposed detection- 
oriented algorithm named Bayesian hypothesis test via be- 
lief propagation (BHT-BP) |71,|8). This algorithm detects 
the signal support through a sequence of binary hypothesis 
tests, where each hypothesis test is designed from the MAP- 
detection criterion using Bayesian philosophy. In our previous 
studies l7lLll8lL we have shown in extensive simulation that 
BHT-BP works better than the estimation-based algorithms, 
such as CS-BP and LASSO, for the SSD problem, particularly 
when situations are noisy. In addition, we noted that BHT- 
BP is noteworthy as a low-computational algorithm having 
0(N log N) order of complexity, enabled by belief propaga- 
tion (BP) working on sparse measurement matrices. In those 
studies, however, the superiority of BHT-BP to the estimation- 
based algorithms was verified only in simulation. 

The main focus of this paper is to introduce a phase 
transition (PT) analysis which can be used to describe how 
the support detection of the BHT-BP algorithm behaves as the 
additive noise level is varied. Namely, it provides an exact 
border line between success and failure of the algorithm on 
the plane of the noise level and the signal magnitude. The 
term "phase transition" was first used by Donoho and Tanner 
[9], [10] in the sparse recovery literature, where the relation 
between the undersampling ratio and the signal sparsity was 
the focus which is different from the work studied here. 

The importance of the signal magnitude, the smallest mag- 
nitude on the support to be more precise, in noisy sparse 
recovery problems has been emphasized in |H,|[6l where 
they have shown that the required number of compressive 
measurements for support detection is inversely proportional 
to the power of the smallest magnitude on the support. Their 
study, however, did not answer the following question: for 
successful support detections, how large should the signal 
magnitude be at a fixed noise level? With the PT analysis in 
this paper, such a statement can be made sharp. In addition, 
in order to verify the superiority of the detection-oriented 
algorithm BHT-BP to the estimation-based one CS-BP, we 
compare the PT region of BHT-BP to that of CS-BP. The 
comparisons are made both in analysis and simulations which 
confirm that the PT region of BHT-BP is larger than that of 
CS-BP. 
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Fig. 1. Channel model for sparse support detection 
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II. Problem Formulation 

A. Signal Model 

We consider a sparse signal x G which is a realization 
of a random vector X. Here we assume that the elements 
of X are Ltd. and that the supportive state of each Xi is 
determined by a Bernoulli random variable Si with a mixing 
rate q := Pr{Si = 1}, i.e., 

1, if *i ^ 
0, else 



5i 



ViG {!,..., iV}. 



(1) 



Hence, the state vector S G {0,1}^ fully contains the support 
information on the signal X. For nonzero values, we consider 
equiprobable signed values i.e., X^s =i where 
5 T denotes the delta function peaked at r. 

Then, the support detector observes a noisy measurement 
vector, i.e., 



• w G 



T).M 



(2) 



y *x 

where we use sparse measurement matrices 3? G {0, l} MxAr 
whose matrix sparsity is regulated by its fixed column weight, 
i.e., \{j : 7^ 0}| = L, and a zero-mean Gaussian vector 
w G 1R M drawn from A/"(0, cr^I) to represent additive white 
noise. 

In the SSD problem, we assume a spike-and-slab prior such 
that for each signal element Xi, it is given by 



(3) 



f Xi (x) := qfxMSi = 1) + (1 " Q)fx t (x\Si = 0) 
= qAT{x)0,aj c ) + (l-q)S , 

where we use /(•) to denote a probability density function 
(PDF). The variance a x is calibrated according the magnitude 
of the target signal x . Namely, if the signal has large values 
on its support, the variance o\ should be sufficiently large for 
the support detection. 

B. Channel Model 

Signal support detection can be performed in an element- 
wise manner on the basis of decoupling principle fTTl . fl2l . 
According to this principle, the vector measurement channel 
can be decoupled to a sequence of scalar Gaussian channels 
in the large system limit (N — ^ oo). In this case, the input of 
each elementwise support detection is a scalar estimate of Xi 
denoted by Zi, as shown in Fig [I] 

The decoupling for the elementwise detection can be 
achieved using an iterative BP algorithm. Indeed, Guo and 



Wang have shown that the BP algorithm finds the marginal 
posteriors of the signal exactly if the matrix <I> is assumed 
to be a sparse matrix with the no-short-cycle property fT3l . 
Such a setting is called large-sparse-system (LSS) setup. Fig[T] 
shows the overall channel model considered in this paper in 
which we assume that the signal length TV is sufficiently large 
to justify the LSS setup. 

C. Problem Statement 

In this study, we aim to analytically compare the noisy 
behavior of the two types of algorithms: BHT-BP and CS- 
BP. The CS-BP algorithm is an estimation-based algorithm 
which obtains the signal estimate directly from the posterior 
density of Z G R N using the MAP or the MMSE estimator 
l3l . Therefore, in CS-BP, the support information is provided 
as a by-product of the signal estimate. Namely, if a scalar 
estimate given by Zi is nonzero, then the algorithm simply 
decides the element belongs to the signal support. Accordingly, 
the detection function for a supportive state Si in CS-BP is 
described by 



CS-BP,i : log — < U, 



(4) 



where Hq := {Si = 0} and Hi := {Si = 1} denote two 
possible hypotheses, and we assume CS-BP uses the MAP- 
estimator such that an estimate of Xi is given as %AP,i '= 
argmax/xi(^|^j, The detection in (HI can be achieved 

with the marginal posterior fxi(x\Y, <3>) since 

fxMZj^) = I fxAx\Zj,Y^l f Y (y\Z % ^)d yi (5) 

Y =f Xi (x\Y,*) 

and / Y (y|Zi,*) > for all y where / x< (a?|Y,Zi, *) = 
fxi (x\Y, <£) is true because Zi is a function of Y. Therefore, 
([4} can be rewritten as 



f Xi (x = X M AP,i|Y,$) 
CS-BP,i — log — — ^ U. 



(6) 



In contrast, for a detection-oriented algorithm BHT-BP, finding 
the sparse support set is an end in itself. Therefore, the 
detection function of BHT-BP is designed from the MAP- 
detection of the supportive state Si, given by 



Pr{S i = l\Z i ,^} n >1 
^ :=Iog Pr{S,=0|Z,,*}|, - 



(7) 
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In ([7]), the posterior probability of a supportive state Si can 
be decomposed as 

Pr^lZi,*} 

Pr{S, |X„ Y, Zi, / Xi (x\Zj,Y, *) x 



*i,Y =Pr{5,|X,,*} =/ Xi (a;|Y,*) 

x f-Y{y\Zu&)dxdy 



Y LX 



/^(x|^)Pr{^}/^(x|Y^; 



da? 



(8) 



where Pr{5i|-Xi, Y, Z i? *} = Pr{5i|Xi,*} holds true be- 
cause Zi and Y are conditionally independent of Si given 
X{. In addition, we know from §5§ that /x^lY, Z^, 3>) = 
fxi(x\Y,&). Therefore, the MAP-detection can be achieved 
by considering only the integral within brackets since 
fy(y\Zi,&) > for all y. Using these facts, the detection 
function of BHT-BP is defined as 



of the Gaussian PDF in dTTb converges to the true value, i.e., 

z/j — ^Z^{Xk\Vx _Jy.- •> ^} ~^ x o,i, and the interference term 

k k 3 

will be eliminated, i.e., a^ El — » 0, as the iteration becomes 

deeper I — > oo under the large system limit (N — » oo) fT3ll . 

For the convergence of BP, we assume that the mixing rate q is 

very small (0 < q <C 1) such that the signal is sparse enough. 

Accordingly, the PDF of messages from the measurement side 

toward Xi converges to a Gaussian PDF with the mean xqj 

and the variance a^, i.e., 

fu Yj ^ x .(u\X i: Y,®) -> M(u-x ^a^). (12) 

As we discussed in Section II-B, the no-short-cycle property 
of the matrix <3> ensures that elements of {Uy^Xi}^^)-.^^^ 
are i.i.d. Then, using this property and the Bayesian rule, the 
marginal posterior of each Xi is obtained as 



h 



BHT-BP 



,i '= log 



log 



f Xi (x\S=l) 



f Xi (x\Y,&)dx Hl 
£0. 



(9) 

These detection functions in ([6]) and ([9]) will be used later on 
for development of the PT analysis in Section III-B. 

As the first step of this analysis, we provide an analytical 
expression of the marginal posterior fx { (x\Y, 3>) obtained via 
BP, under the LSS setup. This posterior expression is used to 
represent the detection function of CS-BP ([6]) and BHT-BP 
^ as a function of aw and xq^. Then, using this result, 
we analyze the failure event for each detection function and 
compare the condition for these two events over the plane of 
the noise level aw and signal magnitude xq^. Our analytical 
and experimental results show that BHT-BP detects the signal 
support more robustly than CS-BP, for the given noise level 
aw and signal magnitude \xo,i\. 

III. Main Result 
A. Derivation of Marginal Signal Posterior 

Let V^L^y. and Uy.^x- re P resent me BP-messages passed 
from Xi to Yj and from Yj to Xi, respectively, for all pairs 
of (i,j) : (j)ji 7^ at the /-th iteration. Our derivation starts 
from the message Uy^ x ., expressed as 

U^ Xi =Yj- J] E{X k \vt%^} + Nj. (10) 



E{X k \V Xk ^ Y ., 



By the central limit theorem (CLT), as a sum of i.i.d. random 
variables, the message Uy.^Xi is asymptotically Gaussian 
under the LSS setup fT3l . Then, we have 

(11) 

where a^ m denotes the variance of the cross-element- 
interference (CEI). In addition, we use the fact that the mean 



by BP 

/x 4 (*|Y,*) = / Xl (x|Y,*,U) 



(13) 



fx t (x)x n f UYj ^ Xi (u\X u Y^) 



where rj[-] is the normalization function ensuring 
f fXi(x\Y,<f>)dx = 1. In addition, note that 
\{j : (frji 0}| ~ L from our signal model; hence, the product 
in ( [T3] ) is made up of L densities for Uy.^Xi Vj : 4>ji ^ 0. 
By applying the prior knowledge given in ([3]) and the result 
of ([12]) to ([13]), we have 



/x«(*|Y,*) 



qc 2 N(x\ 



a 



w 



"La\ 



-) + (l-g)ci£ 



'w 



(14) 



where we use the fact that the product of Gaussian PDFs 
results in a scaled Gaussian PDF, i.e., 

M[x\ ijli, a\) x Af(x; H2, 02) N(x] b, B), 

with B = a 2 1 ° 2 2 , b = ^ lcr 2+M2^i H ence? fa Q constants c\ , C2 

. . <J 1+ <J 2 <J 1+ <J 2 

in ( [14] ) are defined by 



Ci := exp 



/^/2ira 2 w /L, 



and 



c 2 := exp 



2(<4+a^/L) 



>w 



/L). 



The expression in ( [T4] ) reveals that the marginal posterior 
consists of a slab-PDF Mix: T , r ^7^2 ) and a zero- 

spike Jo- F° r convenience, we define the mixing rate pi, the 
mean \ii, and the variance Q\ of the marginal posterior as 



qc 2 + (l-q)c 1 



:= and t ? := 



respectively. Then, using these parameters pi,/ii,9 2 , we can 
rewrite the marginal posterior in ( fl4l > as a spike-and-slab PDF, 



/ Xi (x|Y, *) = Pi Af(x; + (1 - Pi )S . 



(15) 
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Fig. 2. Marginal posterior corresponding to noise level aw when q = 0.05, ax = 5, a?o,i = 2.5, and L = 4 given Si = 1. The figure shows that the 
probability mass in the posterior spreads over the a>axis and approaches the prior PDF, as aw increases. 



B. Phase Transition Analysis of Sparse Support Detection 

We start the phase transition (PT) analysis from studying the 
behavior of the marginal posterior fx { (x\Y, 3?) corresponding 
to the noise level aw- We first examine the two extreme 
cases: aw — > and aw —> oo. In the noiseless setup, 
i.e., aw —> 0, the parameters of fxi(x\Y,&) converges to 
lim pi = 1, lim pi = xq^, lim 9i = 0. Therefore, the 

marginal posterior converges to a delta function peaked at xq^, 
i.e., 

lim f Xi (x\Y,<f>) = 6 Xo .. (16) 

As aw increases, the probability mass in the posterior spreads 
over the x-axis, as shown in Figj2j In the extreme case, i.e., 
aw — > oo, then the parameters converges to lim pi = 
q, lim pi = 0, lim 0i = ax\ hence, the marginal 

a w — yoo &w — 

posterior converges to the prior PDF, i.e., 

lim f Xi (x\Y,*) = f Xi (x). (17) 

Note that the results of ([16]) and (Tf\ are independent of the 
other parameters ax,XQ^,q. These facts indicate that, when 
the measurements Y are clean, the detection of the supportive 
state of xqj can be achieved by either approach given in ([9]) or 
([6]) without uncertainty, whereas in the extremely noisy case, 
the measurements Y are not at all useful for recovery of xqj, 
and the both approaches do not work for the support detection. 

We now consider the failure event of the support detection. 
Let Ti denote the failure event of an index i G {1, N}, i.e., 

Ti := {Decide H u Si = 0} U {Decide U , Si = 1}, (18) 

which is the union of two possible failure cases in ele- 
mentwise support detection. Let us consider the first case 
{Decide Hi, Si = 0} in ([18]). For any zero element, i.e., 
Si = 0, it can be shown that the additive noise does not affect 
the success of the elementwise support detection. Namely, the 
state detection of Si = is always right regardless of the noise 



level, i) When the situation is noiseless, we know from fl6| ) 
that the marginal posterior becomes the delta function peaked 
at the true value Xi$ =0. Therefore, it is obvious that 

arg max lim fx t (x\ Y, <I>, Si = 0) = arg max So 

= 0, (19) 

where the second line holds owing to the nature of the delta 
function 5q. ii) The challenging case is when the noise level 
aw is large. But, from ( [TT] ), we have already seen that 
the marginal posterior converges to the prior density as aw 
increases. Hence, clearly we have 

arg max lim fx { (x\ Y, <£, Si = 0) = arg max fx { (x) 

= 0, (20) 

where the second line holds by definition of the prior density 
given in ([3]). From i) and ii), the peak of fx t (x\ Y, Si = 0) 
remains at x = regardless of the noise level, meaning that the 
state of any zero element having Si = 0, is detected perfectly 
with no failure, i.e., {Decide Hi, Si = 0} = 0. Therefore, the 
failure event Ti is confined to the case 5^ = 1, i.e., 

Ti = {Decide H , Si = 1}. (21) 

This result in pT| ) reveals an important fact which the 
additive noise only disturbs the detection of signal elements 
on the support set. Such a result was also discussed in El, ED, 
in terms of the /i-norm recovery and OMR Returning to ([21]), 
it is worthwhile to note that, the result is valid for both BHT- 
BP and CS-BP because both are derived from the use of the 
marginal posteriors. 

In order to draw the PT boundary of BHT-BP and CS-BP, 
we need to find the condition which causes the failure event 
Ti ([21]) of each detector, with respect to the noise level aw 
and the signal magnitude \xi^\ on the signal support. For each 
element on the support, the failure event is equivalent to the 
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(a):a x =10,^ = 0.02 (b):a x =5, 6/ = 0.02 




Fig. 3. PT diagram for elementwise support detection for various parameter sets of (<rx,q) where the matrix <l> with L = 4 is considered. The dashed 
curve and solid curve indicate BHT-BP and CS-BP, respectively. In these figures, the region above the curves corresponds to the SSD-failure and the region 
below corresponds to the SSD-success. 



case when the detection function is nonpositive, i.e., 

hcs-BP,i( a w,xo,i) < 0, (22) 
for CS-BP from ([6), and 

^BHT-BP,i(^,^0,i) < 0, (23) 

for BHT-BP from ([9]), respectively. Note that /ibht-bp,* and 
^cs-BP,i are functions of the noise level aw and square of the 
signal element x\ { . Therefore, we can ignore the sign of x^o 
and handle the signal magnitude |xo,i| in this analysis. The 
equality condition of ( [23] ), and that of ( [22] ) divide the plane of 
aw and |xo,i| into two distinct regions: an 'SSD-failure' and 
an 'SSD-success', as depicted in Fig[3] In the figure, the region 
above the boundary corresponds to h(aw,%o,i) < 0, which 
describes the failure, whereas the region below corresponds 
to h(aw,xo,i) > 0, which describes the success. Such a 
figure is what we mean by the term PT analysis. Hence, the 
boundary derived from the equality condition determines the 
region of success and failure over the plain of aw and \xo^\. 
The broadness of the success region indicates the recovery 



ability of the corresponding detector. Namely, the wider the 
success region is, the more capable a detector is. 

The BHT-BP boundary provides a wider success region than 
the CS-BP boundary does. Examples are shown in Fig[3]-(a) 
for the parameter set ax = 10, q = 0.02, Fig[3]-(b) for ax = 
5,q = 0.02, Fig[3}(c) for a x = 10, q = 0.05, and Fig[5}(d) 
for ax = 5,g = 0.05 where we consider the matrix <3> with 
L = 4. From these examples, it is evident that BHT-BP is 
superior to CS-BP. In these figures, we also note that BHT-BP 
generally performs better when the signal magnitude \xq^\ is 
larger. 

The result shown in Fig [3] can be interpreted as follows. 
In the case of CS-BP, additive noise produces the event 
T{ when the zero-spike becomes the peak of the marginal 
posterior by exceeding the peak of the slab-PDF, as described 
in ([6]). For example, CS-BP misdetects the supportive state 
with the posteriors of aw > 2 given in Fig[2] In the BHT- 
BP case, however, the detector determines the supportive state 
by considering the noise spreading effect of the posterior, 
which corresponds to the inner products of the marginal 
posterior and the function consisting of the prior knowledge, 
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(a) :<j x =10,q = 0.02,BHT-BP 



(b) :a x =5,q = 0.02, BHT-BP 




(c):cr x =10,^ = 0.02,CS-BP 




(d):a x = 5,^ = 0.02, CS-BP 




Fig. 4. Experimental probability of support detection failure for BHT-BP and CS-BP when N = 1024, q = 0.02, and L = 4. 



i.e., j ^-j^^y fxi (%\Y, &)dx, as described in ([9]). Hence, 
the detection of BHT-BP is performed by incorporating the 
posterior function fxi(x\Y,<&) over the entire x-axis, in 
contrast to that of CS-BP which only considers the function at 
a given point. Therefore, BHT-BP detects the signal support 
against additive noise more robustly than CS-BP does. 

IV. Experimental Results 

We support our analytical results with an experimental 
validation. We measured the probability of the SSD-failure, 
defined as 



Pr{^|^ = l}, 



(24) 



for both BHT-BP and CS-BP over the plain of the noise level 
aw and signal magnitude \xq^\. For the evaluation of each 
experimental point, we used the Monte Carlo method with 
100 trials where each trial is generated under the parameters 
of N = 1024, L = 4 and the undersampling ratio N/M = 0.5. 
To obtain the marginal posteriors of the signal, we used the 
iterative BP algorithm introduced in [3],|7],[8|. 

The experimental failure probability of BHT-BP and CS- 
BP is shown in Figj4] and Figj5] for various parameter sets 



of (ctx,q), with the corresponding analytical boundary given 
in Fig|3] In these figures, the brightness of each experimental 
point represents the value of the failure probability. For exam- 
ple, when the color is bright, the failure probability is close to 
one. These experimental results show that the figures of CS- 
BP include a wider white region than that of BHT-BP. We also 
note in these figures that the transition indeed occurs near the 
analytical boundary. Thus, we can say that these experimental 
results are in good agreement with the analytical results given 
in Section III-B. 

V. Conclusion 



The main aim of this investigation is to answer if a detec- 
tion oriented algorithm BHT-BP [d , (HI provides any better 
results than an estimation based algorithm CS-BP for 
the recovery of sparse support in a noisy underdetermined 
system of equations. A focus is to come up with a measure 
with which superiority of one to the other can be made 
precisely. To this end, we first obtained an expression of the 
marginal posterior as a function of the noise level and signal 
magnitude. Using the posterior expression, we have shown that 
the support detection errors occur only for signal elements on 
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(a) : a x = 10, q = 0.05, BHT-BP 



(b) :a x =5,q = 0.05, BHT-BP 
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(c):a x =10,4 = 0.05, CS-BP 



(d):cr x =5,q= 0.05, CS-BP 
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Fig. 5. Experimental probability of support detection failure for BHT-BP and CS-BP when N = 1024, q = 0.05, and L = 4. 



the support. We used such a fact to find the PT boundary which 
divides the plane of the noise level and signal magnitude into 
two distinct regions: an "SSD-failure" and an "SSD-succes." 
Specifically, the diagram provides information on the required 
signal magnitude for the recovery under a certain noise level or 
the allowable noise level for the recovery given a fixed signal 
magnitude. The PT analysis shows in a clear transition diagram 
how much BHT-BP is better than CS-BP, in recovering the 
sparse support. 



References 

[1] J. A. Tropp, "Just relax: convex programming methods for identifying 
sparse signals in noise," IEEE Trans. Inform. Theory, vol. 52, no. 3, pp. 
1030-1051, 2006. 

[2] R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Roy. 

Statisti. Soc, Ser. B, vol. 58, no. 1, pp. 267-288, 1996. 
[3] D. Baron, S. Sarvotham, and R. Baraniuk, "Bayesian compressive 

sensing via belief propagation," IEEE Trans. Signal Process., vol. 58, 

no. 1, pp. 269-280, Jan. 2010. 
[4] M. J. Wainwright, "Information-theoretic limits on sparsity recovery in 

the high-dimensional and noisy setting," IEEE Trans. Inform. Theory, 

vol. 55, no. 12, pp. 5728-5741, Dec. 2009. 
[5] M. Akcakaya and V. Tarokh, "Shannon-theoretic limit on noisy compres- 
sive sampling," IEEE Trans. Inform. Theory, vol. 56, no. 1, pp. 492-504, 

Jan. 2010. 



[6] A. Fletcher, S. Rangan, and V. Goyal, "Necessary and sufficient con- 
ditions for sparsity pattern recovery," IEEE Trans. Inform. Theory, vol. 
55, no. 12, pp. 5758-5772, Dec. 2009. 

[7] J. Kang, H.-N. Lee, and K. Kim, "Bayesian hypothesis test for sparse 
support recovery using belief propagation," Proc. in IEEE Statistical 
Signal Processing Workshop (SSP), pp. 45-48, Aug. 2012. 

[8] J. Kang, H.-N. Lee, and K. Kim, "Detection-Directed sparse estimation 
using Bayesian hypothesis test and belief propagation," 2012 [Online]. 
Available: arXiv: 121 1.1250 [cs.IT]. 

[9] D. L. Donoho and J. Tanner, "Neighborliness of randomly projected 
simplices in high dimensions," Proc. Nat. Acad. Sci. USA, vol. 102, no. 
27, pp. 9452-9457, 2005. 
[10] D. L. Donoho and J. Tanner, "Precise undersampling theorems," Pro- 
ceeding of the IEEE, vol. 98, issue 6, pp. 913-924, June, 2010. 
[11] D. Guo and S. Verdu, "Randomly spread CDMA: Asymptotics via 
statistical physics," IEEE Trans. Inform. Theory, vol. 51, no. 6, pp. 1983- 
2010, Jun. 2005. 

[12] D. Guo and C.-C. Wang, "Random sparse linear systems observed via 
arbitrary channels: a decoupling principle/'Proc. in IEEE Int. Symp. 
Inform. Theory (ISIT), pp. 946-950, Nice, France, June. 2007. 

[13] D. Guo and C.-C. Wang, "Asymptotic mean-square optimality of belief 
propagation for sparse linear systems," Proc. in IEEE Inform. Theory 
Workshop (ITW), pp. 194-198, Chengdu, China, Oct. 2006. 

[14] D. L. Donoho, M. Elad, and V. Temlyakov, "Stable recovery of sparse 
overcomplete representations in the presence of noise," IEEE Trans. 
Inform. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006. 



